msAggr_seurat
Creating new pipeline using seurat v4.0.2 available 2021.06.23
Important notes:
- FILTERING on
percent.mt, but NOT regressing onpercent.mt - Regressing on
nCounts_RNAandnFeature_RNA
Load libraries required for Seuratv4
library(clustree)
Loading required package: ggraphA note about using SCTransform versus ScaleData
https://bioconductor.org/packages/3.10/workflows/vignettes/simpleSingleCell/inst/doc/batch.html#62_for_gene-based_analyses >You can also normalize and scale data for the RNA assay. There are numerous resources on this, but Aaron Lun describes why the original log-normalized values should be used for DE and visualizations of expression quite well here: > >For gene-based procedures like differential expression (DE) analyses or gene network construction, it is desirable to use the original log-expression values or counts. The corrected values are only used to obtain cell-level results such as clusters or trajectories. Batch effects are handled explicitly using blocking terms or via a meta-analysis across batches. We do not use the corrected values directly in gene-based analyses, for various reasons: > >It is usually inappropriate to perform DE analyses on batch-corrected values, due to the failure to model the uncertainty of the correction. This usually results in loss of type I error control, i.e., more false positives than expected. > >The correction does not preserve the mean-variance relationship. Applications of common DE methods like edgeR or limma are unlikely to be valid. > >Batch correction may (correctly) remove biological differences between batches in the course of mapping all cells onto a common coordinate system. Returning to the uncorrected expression values provides an opportunity for detecting such differences if they are of interest. Conversely, if the batch correction made a mistake, the use of the uncorrected expression values provides an important sanity check. > >In addition, the normalized values in SCT and integrated assays don’t necessary correspond to per-gene expression values anyway, rather containing residuals (in the case of the scale.data slot for each).
Mess with how to load 4 cell populations into single seurat object
SET SEED?????!!!!!
Set global variables
projectName <- "msAggr_seurat"
jackstraw.dim <- 40Store session info
sessionInfo.filename <- paste0(projectName, "_sessionInfo.txt")
sink(sessionInfo.filename)
sessionInfo()
sink()source("~/Desktop/10XGenomicsData/msAggr_scRNASeq/RFunctions/read_10XGenomics_data.R")
source("~/Desktop/10XGenomicsData/msAggr_scRNASeq/RFunctions/PercentVariance.R")
source("~/Desktop/10XGenomicsData/msAggr_scRNASeq/RFunctions/ColorPalette.R")
source("~/Desktop/10XGenomicsData/msAggr_scRNASeq/RFunctions/ColorPalette.R")setwd("~/Desktop/10XGenomicsData/cellRanger/") # temporarily changing wd only works if you run the entire chunk at onceWarning: The working directory was changed to /Users/heustonef/Desktop/10XGenomicsData/cellRanger inside a notebook chunk. The working directory will be reset when the chunk is finished running. Use the knitr root.dir option in the setup chunk to change the working directory for notebook chunks.data_file.list <- read_10XGenomics_data(sample.list = c("LSKm2", "CMPm2", "MEPm", "GMPm"))
data.object<-Read10X(data_file.list)seurat.object<- CreateSeuratObject(counts = data.object, min.cells = 3, min.genes = 200, project = projectName)Clean up to free memory
remove(data.object)Add mitochondrial metadata and plot some basic features
seurat.object[["percent.mt"]] <- PercentageFeatureSet(seurat.object, pattern = "^mt-")
VlnPlot(seurat.object, features = c("nFeature_RNA", "nCount_RNA", "percent.mt"), ncol = 3, pt.size = 0, fill.by = 'orig.ident', )
plot1 <- FeatureScatter(seurat.object, feature1 = "nCount_RNA", feature2 = "percent.mt", group.by = "orig.ident", pt.size = 0.01)
plot2 <- FeatureScatter(seurat.object, feature1 = "nCount_RNA", feature2 = "nFeature_RNA", group.by = "orig.ident", pt.size = 0.01)
plot1 + plot2
remove low quality cells require: nFeature_RNA between 200 and 4000 (inclusive) require: percent.mt <= 5
print(paste("original object:", nrow(seurat.object@meta.data), "cells", sep = " "))[1] "original object: 41950 cells"seurat.object <- subset(seurat.object,
subset = nFeature_RNA >=200 &
nFeature_RNA <= 4000 &
percent.mt <= 5
)
print(paste("new object:", nrow(seurat.object@meta.data), "cells", sep = " "))[1] "new object: 37104 cells"Normalization
Struggling to wrap my head around this one. It seems that SCTransform is best for batch correction, but NormalizeData and ScaleData are best for DGE. Several vignettes have performed both
`selection.method
How to choose top variable features. Choose one of :
vst: First, fits a line to the relationship of log(variance) and log(mean) using local polynomial regression (loess). Then standardizes the feature values using the observed mean and expected variance (given by the fitted line). Feature variance is then calculated on the standardized values after clipping to a maximum (see clip.max parameter).
mean.var.plot (mvp): First, uses a function to calculate average expression (mean.function) and dispersion (dispersion.function) for each feature. Next, divides features into num.bin (deafult 20) bins based on their average expression, and calculates z-scores for dispersion within each bin. The purpose of this is to identify variable features while controlling for the strong relationship between variability and average expression.
dispersion (disp): selects the genes with the highest dispersion values`
seurat.object <- NormalizeData(seurat.object, normalization.method = "LogNormalize", scale.factor = 10000)Performing log-normalization
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Find variable features
seurat.object <- FindVariableFeatures(seurat.object, selection.method = "vst", nfeatures = 2000)Calculating gene variances
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
Calculating feature variances of standardized and clipped values
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|top10 <- head(VariableFeatures(seurat.object), 10)
plot1 <- VariableFeaturePlot(seurat.object)
plot2 <- LabelPoints(plot = plot1, points = top10, repel = TRUE)When using repel, set xnudge and ynudge to 0 for optimal resultsplot1 + plot2Warning: Transformation introduced infinite values in continuous x-axis
Warning: Removed 2 rows containing missing values (geom_point).
Warning: Transformation introduced infinite values in continuous x-axis
Warning: Removed 2 rows containing missing values (geom_point).
Scale data (linear transformation)
all.genes <- rownames(seurat.object)
seurat.object <- ScaleData(seurat.object, features = all.genes, vars.to.regress = c("nCount_RNA", "nFeature_RNA"))Regressing out nCount_RNA, nFeature_RNA
|
| | 0%
|
|= | 0%
|
|= | 1%
|
|== | 1%
|
|=== | 1%
|
|=== | 2%
|
|==== | 2%
|
|===== | 2%
|
|===== | 3%
|
|====== | 3%
|
|======= | 3%
|
|======== | 3%
|
|======== | 4%
|
|========= | 4%
|
|========== | 4%
|
|========== | 5%
|
|=========== | 5%
|
|============ | 5%
|
|============ | 6%
|
|============= | 6%
|
|============== | 6%
|
|============== | 7%
|
|=============== | 7%
|
|================ | 7%
|
|================ | 8%
|
|================= | 8%
|
|================== | 8%
|
|================== | 9%
|
|=================== | 9%
|
|==================== | 9%
|
|==================== | 10%
|
|===================== | 10%
|
|====================== | 10%
|
|======================= | 10%
|
|======================= | 11%
|
|======================== | 11%
|
|========================= | 11%
|
|========================= | 12%
|
|========================== | 12%
|
|=========================== | 12%
|
|=========================== | 13%
|
|============================ | 13%
|
|============================= | 13%
|
|============================= | 14%
|
|============================== | 14%
|
|=============================== | 14%
|
|=============================== | 15%
|
|================================ | 15%
|
|================================= | 15%
|
|================================= | 16%
|
|================================== | 16%
|
|=================================== | 16%
|
|=================================== | 17%
|
|==================================== | 17%
|
|===================================== | 17%
|
|====================================== | 17%
|
|====================================== | 18%
|
|======================================= | 18%
|
|======================================== | 18%
|
|======================================== | 19%
|
|========================================= | 19%
|
|========================================== | 19%
|
|========================================== | 20%
|
|=========================================== | 20%
|
|============================================ | 20%
|
|============================================ | 21%
|
|============================================= | 21%
|
|============================================== | 21%
|
|============================================== | 22%
|
|=============================================== | 22%
|
|================================================ | 22%
|
|================================================ | 23%
|
|================================================= | 23%
|
|================================================== | 23%
|
|=================================================== | 23%
|
|=================================================== | 24%
|
|==================================================== | 24%
|
|===================================================== | 24%
|
|===================================================== | 25%
|
|====================================================== | 25%
|
|======================================================= | 25%
|
|======================================================= | 26%
|
|======================================================== | 26%
|
|========================================================= | 26%
|
|========================================================= | 27%
|
|========================================================== | 27%
|
|=========================================================== | 27%
|
|=========================================================== | 28%
|
|============================================================ | 28%
|
|============================================================= | 28%
|
|============================================================= | 29%
|
|============================================================== | 29%
|
|=============================================================== | 29%
|
|=============================================================== | 30%
|
|================================================================ | 30%
|
|================================================================= | 30%
|
|================================================================== | 30%
|
|================================================================== | 31%
|
|=================================================================== | 31%
|
|==================================================================== | 31%
|
|==================================================================== | 32%
|
|===================================================================== | 32%
|
|====================================================================== | 32%
|
|====================================================================== | 33%
|
|======================================================================= | 33%
|
|======================================================================== | 33%
|
|======================================================================== | 34%
|
|========================================================================= | 34%
|
|========================================================================== | 34%
|
|========================================================================== | 35%
|
|=========================================================================== | 35%
|
|============================================================================ | 35%
|
|============================================================================ | 36%Save progress
# save.image(file = paste0(projectName, '.RData'))
saveRDS(seurat.object, file = paste0(projectName, "_raw.RDS"))PCA
linear dimensional reduction. Default are based on VariableFeatures, but can be changed
seurat.object <- RunPCA(seurat.object, features = VariableFeatures(object = seurat.object))PC_ 1
Positive: Car2, Car1, Blvrb, Klf1, Mt2, Vamp5, Ermap, Aqp1, C1qtnf12, Rhd
Sphk1, Ces2g, Tspo2, Cldn13, Gm15915, Slc38a5, Gstm5, Smim1, Abcb4, Gclm
Ybx3, Nxpe2, Ctse, Cenpv, Stard10, Mns1, Gata1, Slc25a21, Sdsl, Epor
Negative: Tmsb4x, Prtn3, Mpo, Ctsg, Tyrobp, Plac8, Elane, Clec12a, Ly6c2, Slpi
Sh3bgrl3, Anxa3, Pkm, Hp, Emb, Fcer1g, Ms4a3, Pgam1, Ms4a6c, Irf8
Coro1a, Serpinb1a, BC035044, Lgals1, H2afy, Arhgdib, Igsf6, Alas1, Ly86, Cst3
PC_ 2
Positive: Ctla2a, Malat1, Ifitm1, Hlf, Gimap6, Jund, Fos, Tsc22d1, Ltb, Gimap1
Tmem176b, Pim1, Adgrl4, Ifitm3, Sox4, Zfp36, Adgrg1, Cd34, Gcnt2, Rgs1
Klf2, Gm5111, Cd27, Ypel3, Klf6, Gm19590, Dusp1, Dusp2, Ifi203, Shisa5
Negative: H2afz, Ybx1, Ppia, Atp5g1, Ran, Mt1, Ranbp1, Cycs, Nme1, Hmgb2
Cks2, Slc25a5, Cox5a, Cks1b, Ap3s1, Atpif1, Dut, Eif5a, Ptma, Sdf2l1
Nhp2, Dynll1, Elane, Mrpl18, Atp5o, Ms4a3, Tmem14c, Chchd2, Ly6c2, Birc5
PC_ 3
Positive: Ube2c, Nusap1, Plbd1, Cenpf, Birc5, Lgals3, Aif1, Mki67, Id2, Hmmr
Top2a, Prc1, Ifi205, Cdca8, Kif23, Batf3, H2afx, Cenpa, Tpx2, Ccnb1
Ccnb2, Kif22, Cdc20, Plk1, Cenpe, Hmgb2, Pimreg, Racgap1, H2-Aa, Cdca3
Negative: Cd63, Srgn, Mif, Ung, Prtn3, Rgcc, Ms4a3, Srm, Gstm1, Elane
Nkg7, Hspd1, Cebpe, Alas1, Fkbp11, Hsp90ab1, Mpo, Ctsg, Prdx6, Trem3
Calr, Gsr, Serpinb1a, Rps2, Nme1, Prss57, Anxa3, Cst7, Fcgr3, Rack1
PC_ 4
Positive: Srgn, Nkg7, Itga2b, Cd9, Pf4, Ube2c, Lockd, Apoe, Cavin2, Nusap1
Cenpf, H1fx, Cks2, Serpine2, Cd63, Gata2, Hmmr, Pimreg, Cdc20, Tuba8
Ckap2l, Pbx1, Prc1, Cdca8, Ccnb2, Pdcd4, Rab27b, Tpx2, Malat1, Rgs18
Negative: Aif1, Ctss, Irf8, Cd74, Lsp1, Plbd1, Lgals3, H2-Aa, Cd52, Id2
Ifi205, H2-Eb1, Ccr2, Pld4, Batf3, Psap, Ighm, Mpeg1, H2-Ab1, Ckb
Ly86, Itgb7, Ms4a4c, Ifi30, Ctsh, Fth1, Naaa, Ms4a6c, Tmsb10, Jaml
PC_ 5
Positive: Ftl1, S100a8, Pglyrp1, Clec4a2, Rgcc, Gstm1, S100a6, Trem3, Gda, Wfdc21
Lgals3, Dstn, Slfn2, Prdx5, Hp, H2-Eb1, Ly6c2, H2-Aa, Cd74, Cebpe
Gng11, Cd63, Mcemp1, Fcgr3, Ms4a3, Mmrn1, Mt1, Hacd4, Pdzk1ip1, Selenom
Negative: Stmn1, H2afy, Ptma, Plac8, Hsp90ab1, Tmsb10, Rps2, Cd34, Bcl2, Hspa8
Sox4, Npm1, Hist1h2ap, Cpa3, Cd48, Tespa1, Satb1, Ccl9, Fos, Ppia
Hist1h2ae, Hist1h2ac, Hmgb1, Lat2, Fabp5, BC035044, Jun, Dntt, Adgrg3, Egr1 Plot results
VizDimLoadings(seurat.object, dims = 1:6, nfeatures = 10, reduction = "pca", ncol = 2)
DimPlot colored by orig.ident
DimPlot(seurat.object, reduction = "pca", group.by = "orig.ident")
Let’s put in a concerted effort to pick the right dimensionality using the newest software
```r
# jackstraw.dim <- 40
# seurat.object <- JackStraw(seurat.object, num.replicate = 100, dims = jackstraw.dim) #runs ~50 min
# seurat.object <- ScoreJackStraw(seurat.object, dims = 1:jackstraw.dim)
# save.image(paste0(projectName, \.RData\))
<!-- rnb-source-end -->
<!-- rnb-chunk-end -->
<!-- rnb-text-begin -->
Draw dim.reduction plots
<!-- rnb-text-end -->
<!-- rnb-chunk-begin -->
<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuIyBKYWNrU3RyYXdQbG90KHNldXJhdC5vYmplY3QsIGRpbXMgPSAyNTozNilcbmBgYFxuYGBgIn0= -->
```r
```r
# JackStrawPlot(seurat.object, dims = 25:36)
<!-- rnb-source-end -->
<!-- rnb-chunk-end -->
<!-- rnb-chunk-begin -->
<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuRWxib3dQbG90KHNldXJhdC5vYmplY3QsIG5kaW1zID0gNTApXG5wZXJjZW50LnZhcmlhbmNlKHNldXJhdC5vYmplY3RAcmVkdWN0aW9ucyRwY2FAc3RkZXYpXG5gYGAifQ== -->
```r
ElbowPlot(seurat.object, ndims = 50)
percent.variance(seurat.object@reductions$pca@stdev)Number of PCs describing X% of variance
ElbowPlot(seurat.object, ndims = 50)
percent.variance(seurat.object@reductions$pca@stdev)
Percent of PCs describing X% of variance (transcribed from above cell because I don’t know how to freeze results)
Num pcs for 80% variance: 12 Num pcs for 85% variance: 18 Num pcs for 90% variance: 26 Num pcs for 95% variance: 37
ID clusters based on different variances
Describe 80% of variance with 12 dimensions
Neighborhood and umap
set total.var <- 80%
tot.var <- percent.variance(seurat.object@reductions$pca@stdev, plot.var = FALSE, return.val = TRUE)
paste0("Num pcs for 80% variance: ", length(which(cumsum(tot.var) <= 80)))[1] "Num pcs for 80% variance: 12"paste0("Num pcs for 85% variance: ", length(which(cumsum(tot.var) <= 85)))[1] "Num pcs for 85% variance: 18"paste0("Num pcs for 90% variance: ", length(which(cumsum(tot.var) <= 90)))[1] "Num pcs for 90% variance: 26"paste0("Num pcs for 95% variance: ", length(which(cumsum(tot.var) <= 95)))[1] "Num pcs for 95% variance: 37"Plot UMAP
for(x in c(0.5, 1, 1.5, 2, 2.5)){
seurat.object <- FindClusters(seurat.object, resolution = x)
}for (meta.col in colnames(seurat.object@meta.data)){
if(grepl(pattern = ("RNA_snn_res"), x = meta.col)==TRUE){
myplot <- DimPlot(seurat.object,
group.by = meta.col,
reduction = "umap",
cols = color.palette
) +
ggtitle(paste0(projectName, " dim", ndims, "res", gsub("RNA_snn_res", "", meta.col) ))
plot(myplot)
}
}saveRDS(seurat.object, file = paste0(projectName, "_dim", ndims, ".RDS"))Generate statistics for each cluster/resolution combo
current_res <- 'RNA_snn_res.0.5'
cluster_ids <- sort(unique(seurat.object@meta.data[,current_res]))
counts_df <- data.frame(matrix(nrow = length(cluster_ids), ncol = 4))
rownames(counts_df) <- cluster_ids
colnames(counts_df) <- c("LSKm2", "CMPm2", "MEPm", "GMPm")
for(id in cluster_ids){
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "LSKm2"),])
counts_df[id, "LSKm2"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "LSKm2"),])
counts_df[id, "CMPm2"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "MEPm"),])
counts_df[id, "MEPm"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "GMPm"),])
counts_df[id, "GMPm"] = cell_value
}
Evaluate cluster stability
clustree(seurat.object, prefix = "RNA_snn_res.", node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'scale.data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'counts', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')Describe 85% of variance with 18 dimensions
Neighborhood and umap
set total.var <- 85%
tot.var <- percent.variance(seurat.object@reductions$pca@stdev, plot.var = FALSE, return.val = TRUE)
ndims <- length(which(cumsum(tot.var) <= 85))
seurat.object <- FindNeighbors(seurat.object, dims = 1:ndims)
seurat.object <- FindClusters(seurat.object, resolution = 0.5)
seurat.object <- RunUMAP(seurat.object, dims = 1: ndims)
Plot UMAP
tot.var <- percent.variance(seurat.object@reductions$pca@stdev, plot.var = FALSE, return.val = TRUE)
ndims <- length(which(cumsum(tot.var) <= 85))
seurat.object <- FindNeighbors(seurat.object, dims = 1:ndims)Computing nearest neighbor graphComputing SNNseurat.object <- FindClusters(seurat.object, resolution = 0.5)Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1210978
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8975
Number of communities: 15
Elapsed time: 7 secondsseurat.object <- RunUMAP(seurat.object, dims = 1: ndims)10:28:27 UMAP embedding parameters a = 0.9922 b = 1.112
10:28:27 Read 37104 rows and found 18 numeric columns
10:28:27 Using Annoy for neighbor search, n_neighbors = 30
10:28:27 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
10:28:30 Writing NN index file to temp file /var/folders/4f/fwrj6fnn1dn4g8wsf0zv563hjsvl24/T//RtmpMfek2E/file6cd4e41ca37
10:28:30 Searching Annoy index using 1 thread, search_k = 3000
10:28:38 Annoy recall = 100%
10:28:39 Commencing smooth kNN distance calibration using 1 thread
10:28:40 Initializing from normalized Laplacian + noise
10:28:42 Commencing optimization for 200 epochs, with 1505258 positive edges
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
10:28:58 Optimization finishedfor(x in c(0.5, 1, 1.5, 2, 2.5)){
seurat.object <- FindClusters(seurat.object, resolution = x)
}Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1210978
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8975
Number of communities: 15
Elapsed time: 7 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1210978
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8630
Number of communities: 23
Elapsed time: 6 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1210978
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8382
Number of communities: 31
Elapsed time: 7 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1210978
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8202
Number of communities: 36
Elapsed time: 6 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1210978
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8042
Number of communities: 45
Elapsed time: 6 secondsfor (meta.col in colnames(seurat.object@meta.data)){
if(grepl(pattern = ("RNA_snn_res"), x = meta.col)==TRUE){
myplot <- DimPlot(seurat.object,
group.by = meta.col,
reduction = "umap",
cols = color.palette
) +
ggtitle(paste0(projectName, " dim", ndims, "res", gsub("RNA_snn_res", "", meta.col) ))
plot(myplot)
}
}
Generate statistics for each cluster/resolution combo
saveRDS(seurat.object, file = paste0(projectName, "_dim", ndims, ".RDS"))Evaluate cluster stability
Must ensure we have the right cluster stability, that is, cells that start in the same cluster tend to stay in the same cluster. If your data is over-clustered, cells will bounce between groups.
Following [this tutorial by Matt O.].https://towardsdatascience.com/10-tips-for-choosing-the-optimal-number-of-clusters-277e93d72d92. Previously my favourite has been Clustree, which gives a nice visual NB: For some reason clustree::clustree() didn’t work, whereas library(clustree) followed by clustree() did.
current_res <- 'RNA_snn_res.0.5'
cluster_ids <- sort(unique(seurat.object@meta.data[,current_res]))
counts_df <- data.frame(matrix(nrow = length(cluster_ids), ncol = 4))
rownames(counts_df) <- cluster_ids
colnames(counts_df) <- c("LSKm2", "CMPm2", "MEPm", "GMPm")
for(id in cluster_ids){
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "LSKm2"),])
counts_df[id, "LSKm2"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "LSKm2"),])
counts_df[id, "CMPm2"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "MEPm"),])
counts_df[id, "MEPm"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "GMPm"),])
counts_df[id, "GMPm"] = cell_value
}
clustree(seurat.object, prefix = "RNA_snn_res.", node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')Warning: The `add` argument of `group_by()` is deprecated as of dplyr 1.0.0.
Please use the `.add` argument instead.
This warning is displayed once every 8 hours.
Call `lifecycle::last_warnings()` to see where this warning was generated.
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'scale.data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
Describe 90% of variance with 26 dimensions
Neighborhood and umap
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'counts', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
Plot UMAP
tot.var <- percent.variance(seurat.object@reductions$pca@stdev, plot.var = FALSE, return.val = TRUE)
ndims <- length(which(cumsum(tot.var) <= 90))
seurat.object <- FindNeighbors(seurat.object, dims = 1:ndims)Computing nearest neighbor graphComputing SNNseurat.object <- FindClusters(seurat.object, resolution = 0.5)Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8962
Number of communities: 13
Elapsed time: 8 secondsseurat.object <- RunUMAP(seurat.object, dims = 1: ndims)09:54:54 UMAP embedding parameters a = 0.9922 b = 1.112
09:54:54 Read 37104 rows and found 26 numeric columns
09:54:54 Using Annoy for neighbor search, n_neighbors = 30
09:54:54 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
09:54:57 Writing NN index file to temp file /var/folders/4f/fwrj6fnn1dn4g8wsf0zv563hjsvl24/T//RtmpMfek2E/file6cd429d4fb06
09:54:57 Searching Annoy index using 1 thread, search_k = 3000
09:55:05 Annoy recall = 100%
09:55:06 Commencing smooth kNN distance calibration using 1 thread
09:55:07 Initializing from normalized Laplacian + noise
09:55:09 Commencing optimization for 200 epochs, with 1544862 positive edges
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
09:55:25 Optimization finishedfor(x in c(0.5, 1, 1.5, 2, 2.5)){
seurat.object <- FindClusters(seurat.object, resolution = x)
}Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8962
Number of communities: 13
Elapsed time: 8 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8602
Number of communities: 23
Elapsed time: 6 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8355
Number of communities: 30
Elapsed time: 6 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8156
Number of communities: 36
Elapsed time: 7 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8006
Number of communities: 42
Elapsed time: 7 secondsfor (meta.col in colnames(seurat.object@meta.data)){
if(grepl(pattern = ("RNA_snn_res"), x = meta.col)==TRUE){
myplot <- DimPlot(seurat.object,
group.by = meta.col,
reduction = "umap",
cols = color.palette
) +
ggtitle(paste0(projectName, " dim", ndims, "res", gsub("RNA_snn_res", "", meta.col) ))
plot(myplot)
}
}
Generate statistics for each cluster/resolution combo
saveRDS(seurat.object, file = paste0(projectName, "_dim", ndims, ".RDS"))Evaluate cluster stability
current_res <- 'RNA_snn_res.0.5'
cluster_ids <- sort(unique(seurat.object@meta.data[,current_res]))
counts_df <- data.frame(matrix(nrow = length(cluster_ids), ncol = 4))
rownames(counts_df) <- cluster_ids
colnames(counts_df) <- c("LSKm2", "CMPm2", "MEPm", "GMPm")
for(id in cluster_ids){
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "LSKm2"),])
counts_df[id, "LSKm2"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "LSKm2"),])
counts_df[id, "CMPm2"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "MEPm"),])
counts_df[id, "MEPm"] = cell_value
cell_value <- nrow(seurat.object@meta.data[(seurat.object@meta.data[current_res] == id) &
(seurat.object@meta.data$orig.ident == "GMPm"),])
counts_df[id, "GMPm"] = cell_value
}
clustree(seurat.object, prefix = "RNA_snn_res.", node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
png(filename = paste0(projectName, "_dim", ndims, "-clustree.png"), height = 800, width = 1600)clustree(seurat.object, prefix = "RNA_snn_res.", node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
dev.off()quartz_off_screen
2 
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'scale.data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
Describe 95% of variance with 37 dimensions
Neighborhood and umap
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'counts', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
Plot UMAP
tot.var <- percent.variance(seurat.object@reductions$pca@stdev, plot.var = FALSE, return.val = TRUE)
ndims <- length(which(cumsum(tot.var) <= 95))
seurat.object <- FindNeighbors(seurat.object, dims = 1:ndims)Computing nearest neighbor graphComputing SNNseurat.object <- FindClusters(seurat.object, resolution = 0.5)Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1328463
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8955
Number of communities: 13
Elapsed time: 7 secondsseurat.object <- RunUMAP(seurat.object, dims = 1: ndims)10:02:17 UMAP embedding parameters a = 0.9922 b = 1.112
10:02:17 Read 37104 rows and found 37 numeric columns
10:02:17 Using Annoy for neighbor search, n_neighbors = 30
10:02:17 Building Annoy index with metric = cosine, n_trees = 50
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
10:02:21 Writing NN index file to temp file /var/folders/4f/fwrj6fnn1dn4g8wsf0zv563hjsvl24/T//RtmpMfek2E/file6cd45dac5c5e
10:02:21 Searching Annoy index using 1 thread, search_k = 3000
10:02:29 Annoy recall = 100%
10:02:30 Commencing smooth kNN distance calibration using 1 thread
10:02:31 Initializing from normalized Laplacian + noise
10:02:32 Commencing optimization for 200 epochs, with 1590084 positive edges
0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
10:02:49 Optimization finishedfor(x in c(0.5, 1, 1.5, 2, 2.5)){
seurat.object <- FindClusters(seurat.object, resolution = x)
}Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8962
Number of communities: 13
Elapsed time: 8 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8602
Number of communities: 23
Elapsed time: 6 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8355
Number of communities: 30
Elapsed time: 6 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8156
Number of communities: 36
Elapsed time: 7 seconds
Modularity Optimizer version 1.3.0 by Ludo Waltman and Nees Jan van Eck
Number of nodes: 37104
Number of edges: 1255141
Running Louvain algorithm...0% 10 20 30 40 50 60 70 80 90 100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|Maximum modularity in 10 random starts: 0.8006
Number of communities: 42
Elapsed time: 7 secondsfor (meta.col in colnames(seurat.object@meta.data)){
if(grepl(pattern = ("RNA_snn_res"), x = meta.col)==TRUE){
myplot <- DimPlot(seurat.object,
group.by = meta.col,
reduction = "umap",
cols = color.palette
) +
ggtitle(paste0(projectName, " dim", ndims, "res", gsub("RNA_snn_res", "", meta.col) ))
plot(myplot)
}
}
Generate statistics for each cluster/resolution combo
saveRDS(seurat.object, file = paste0(projectName, "_dim", ndims, ".RDS"))Evaluate cluster stability
current_res <- 'RNA_snn_res.0.5'
cluster_ids <- sort(unique(seurat.object@meta.data[,current_res]))clustree(seurat.object, prefix = "RNA_snn_res.", node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'scale.data', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
DGE
I think clusters from 90% variance at 0.5 and 1.0 resolution are most stable. We’ll do some statistics and DGE on that. Will also need to go back and play with SCTransform, since these are multiple cell types from multiple lanes.
clustree(seurat.object, prefix = "RNA_snn_res.", expres = 'counts', node_colour = "sc3_stability") +
scale_color_continuous(low = 'red3', high = 'white')
Notes on cluster stability
Cluster stability could be influenced by: * cells in each population (cellranger v6 includes more cells than cellranger v1, especially in MEP) * dimensionality is incorrect * ScaleData didnt account for regression factors (e.g., “nCounts_RNA” or “nFeatures_RNA”) * Did not consider cell cycle * Incorrect normalization/scaling method * Clustering is too strict or not strict enough * neighborhood analysis used wrong parameters * Should include mitoC filter (there’s a chunk of MEP w/ mitoC @ ~40%) * SCTransform accounts better for sources of variability
# Number of filtered cells left in each pop
sapply(c("LSKm2", "CMPm2", "MEPm", "GMPm"), function(x) (c(nrow(seurat.object@meta.data[seurat.object@meta.data$orig.ident == x,]))))```r
# Number of filtered cells left in each pop
sapply(c(\LSKm2\, \CMPm2\, \MEPm\, \GMPm\), function(x) (c(nrow(seurat.object@meta.data[seurat.object@meta.data$orig.ident == x,]))))
<!-- rnb-source-end -->
<!-- rnb-chunk-end -->
<!-- rnb-text-begin -->
Looks like MEPm is the only sample with that huge MitoC % lump @ 40%. What do these cells look like, otherwise?
<!-- rnb-text-end -->
<!-- rnb-chunk-begin -->
<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuZm9yICh4IGluIGMoXFxMU0ttMlxcLCBcXENNUG0yXFwsIFxcTUVQbVxcLCBcXEdNUG1cXCkpe1xuXHRoID0gaGlzdChzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVtzZXVyYXQub2JqZWN0QG1ldGEuZGF0YSRvcmlnLmlkZW50ID09IHgsICdwZXJjZW50Lm10J10sIGJyZWFrcyA9IDMwLCBwbG90ID0gRkFMU0UpXG5cdGgkZGVuc2l0eSA9IGgkY291bnRzL3N1bShoJGNvdW50cykqMTAwXG5cdHBsb3QoaCxmcmVxPUZBTFNFLCBtYWluID0gIHBhc3RlKHgsIFxccGVyY2VudCBtaXRvQ1xcKSwgeGxhYiA9IFxccGVyY2VudCBtaXRvQ1xcLCB5bGFiID0gXFxGcmVxdWVuY3lcXClcbn1cbmBgYFxuYGBgIn0= -->
```r
```r
for (x in c(\LSKm2\, \CMPm2\, \MEPm\, \GMPm\)){
h = hist(seurat.object@meta.data[seurat.object@meta.data$orig.ident == x, 'percent.mt'], breaks = 30, plot = FALSE)
h$density = h$counts/sum(h$counts)*100
plot(h,freq=FALSE, main = paste(x, \percent mitoC\), xlab = \percent mitoC\, ylab = \Frequency\)
}```
LS0tCnRpdGxlOiAibXNBZ2dyX3NldXJhdCIKb3V0cHV0OiBodG1sX25vdGVib29rCi0tLQoKQ3JlYXRpbmcgbmV3IHBpcGVsaW5lIHVzaW5nIHNldXJhdCB2NC4wLjIgYXZhaWxhYmxlIDIwMjEuMDYuMjMgIApJbXBvcnRhbnQgbm90ZXM6CgoqIEZJTFRFUklORyBvbiBgcGVyY2VudC5tdGAsIGJ1dCBOT1QgcmVncmVzc2luZyBvbiBgcGVyY2VudC5tdGAKKiBSZWdyZXNzaW5nIG9uIGBuQ291bnRzX1JOQWAgYW5kIGBuRmVhdHVyZV9STkFgCgpMb2FkIGxpYnJhcmllcyByZXF1aXJlZCBmb3IgU2V1cmF0djQKCmBgYHtyIHNldHVwLCBtZXNzYWdlPUZBTFNFLCB3YXJuaW5nPUZBTFNFfQprbml0cjo6b3B0c19rbml0JHNldChyb290LmRpciA9ICJ+L0Rlc2t0b3AvMTBYR2Vub21pY3NEYXRhL21zQWdncl9zY1JOQVNlcS9tc0FnZ3Jfc2V1cmF0LyIpCmxpYnJhcnkoZHBseXIpCmxpYnJhcnkoU2V1cmF0KQpsaWJyYXJ5KHBhdGNod29yaykKbGlicmFyeShnZ3Bsb3QyKQpsaWJyYXJ5KGNsdXN0cmVlKQpgYGAKCiMgQSBub3RlIGFib3V0IHVzaW5nIFNDVHJhbnNmb3JtIHZlcnN1cyBgU2NhbGVEYXRhYApodHRwczovL2Jpb2NvbmR1Y3Rvci5vcmcvcGFja2FnZXMvMy4xMC93b3JrZmxvd3MvdmlnbmV0dGVzL3NpbXBsZVNpbmdsZUNlbGwvaW5zdC9kb2MvYmF0Y2guaHRtbCM2Ml9mb3JfZ2VuZS1iYXNlZF9hbmFseXNlcwo+WW91IGNhbiBhbHNvIG5vcm1hbGl6ZSBhbmQgc2NhbGUgZGF0YSBmb3IgdGhlIFJOQSBhc3NheS4gVGhlcmUgYXJlIG51bWVyb3VzIHJlc291cmNlcyBvbiB0aGlzLCBidXQgQWFyb24gTHVuIGRlc2NyaWJlcyB3aHkgdGhlIG9yaWdpbmFsIGxvZy1ub3JtYWxpemVkIHZhbHVlcyBzaG91bGQgYmUgdXNlZCBmb3IgREUgYW5kIHZpc3VhbGl6YXRpb25zIG9mIGV4cHJlc3Npb24gcXVpdGUgd2VsbCBoZXJlOgo+Cj5Gb3IgZ2VuZS1iYXNlZCBwcm9jZWR1cmVzIGxpa2UgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gKERFKSBhbmFseXNlcyBvciBnZW5lIG5ldHdvcmsgY29uc3RydWN0aW9uLCBpdCBpcyBkZXNpcmFibGUgdG8gdXNlIHRoZSBvcmlnaW5hbCBsb2ctZXhwcmVzc2lvbiB2YWx1ZXMgb3IgY291bnRzLiBUaGUgY29ycmVjdGVkIHZhbHVlcyBhcmUgb25seSB1c2VkIHRvIG9idGFpbiBjZWxsLWxldmVsIHJlc3VsdHMgc3VjaCBhcyBjbHVzdGVycyBvciB0cmFqZWN0b3JpZXMuIEJhdGNoIGVmZmVjdHMgYXJlIGhhbmRsZWQgZXhwbGljaXRseSB1c2luZyBibG9ja2luZyB0ZXJtcyBvciB2aWEgYSBtZXRhLWFuYWx5c2lzIGFjcm9zcyBiYXRjaGVzLiBXZSBkbyBub3QgdXNlIHRoZSBjb3JyZWN0ZWQgdmFsdWVzIGRpcmVjdGx5IGluIGdlbmUtYmFzZWQgYW5hbHlzZXMsIGZvciB2YXJpb3VzIHJlYXNvbnM6Cj4KPkl0IGlzIHVzdWFsbHkgaW5hcHByb3ByaWF0ZSB0byBwZXJmb3JtIERFIGFuYWx5c2VzIG9uIGJhdGNoLWNvcnJlY3RlZCB2YWx1ZXMsIGR1ZSB0byB0aGUgZmFpbHVyZSB0byBtb2RlbCB0aGUgdW5jZXJ0YWludHkgb2YgdGhlIGNvcnJlY3Rpb24uIFRoaXMgdXN1YWxseSByZXN1bHRzIGluIGxvc3Mgb2YgdHlwZSBJIGVycm9yIGNvbnRyb2wsIGkuZS4sIG1vcmUgZmFsc2UgcG9zaXRpdmVzIHRoYW4gZXhwZWN0ZWQuCj4KPlRoZSBjb3JyZWN0aW9uIGRvZXMgbm90IHByZXNlcnZlIHRoZSBtZWFuLXZhcmlhbmNlIHJlbGF0aW9uc2hpcC4gQXBwbGljYXRpb25zIG9mIGNvbW1vbiBERSBtZXRob2RzIGxpa2UgZWRnZVIgb3IgbGltbWEgYXJlIHVubGlrZWx5IHRvIGJlIHZhbGlkLgo+Cj5CYXRjaCBjb3JyZWN0aW9uIG1heSAoY29ycmVjdGx5KSByZW1vdmUgYmlvbG9naWNhbCBkaWZmZXJlbmNlcyBiZXR3ZWVuIGJhdGNoZXMgaW4gdGhlIGNvdXJzZSBvZiBtYXBwaW5nIGFsbCBjZWxscyBvbnRvIGEgY29tbW9uIGNvb3JkaW5hdGUgc3lzdGVtLiBSZXR1cm5pbmcgdG8gdGhlIHVuY29ycmVjdGVkIGV4cHJlc3Npb24gdmFsdWVzIHByb3ZpZGVzIGFuIG9wcG9ydHVuaXR5IGZvciBkZXRlY3Rpbmcgc3VjaCBkaWZmZXJlbmNlcyBpZiB0aGV5IGFyZSBvZiBpbnRlcmVzdC4gQ29udmVyc2VseSwgaWYgdGhlIGJhdGNoIGNvcnJlY3Rpb24gbWFkZSBhIG1pc3Rha2UsIHRoZSB1c2Ugb2YgdGhlIHVuY29ycmVjdGVkIGV4cHJlc3Npb24gdmFsdWVzIHByb3ZpZGVzIGFuIGltcG9ydGFudCBzYW5pdHkgY2hlY2suCj4KPkluIGFkZGl0aW9uLCB0aGUgbm9ybWFsaXplZCB2YWx1ZXMgaW4gU0NUIGFuZCBpbnRlZ3JhdGVkIGFzc2F5cyBkb24ndCBuZWNlc3NhcnkgY29ycmVzcG9uZCB0byBwZXItZ2VuZSBleHByZXNzaW9uIHZhbHVlcyBhbnl3YXksIHJhdGhlciBjb250YWluaW5nIHJlc2lkdWFscyAoaW4gdGhlIGNhc2Ugb2YgdGhlIHNjYWxlLmRhdGEgc2xvdCBmb3IgZWFjaCkuCgoKCk1lc3Mgd2l0aCBob3cgdG8gbG9hZCA0IGNlbGwgcG9wdWxhdGlvbnMgaW50byBzaW5nbGUgc2V1cmF0IG9iamVjdAoKCgpTRVQgU0VFRD8/Pz8/ISEhISEKCiMjIFNldCBnbG9iYWwgdmFyaWFibGVzCgpgYGB7cn0KcHJvamVjdE5hbWUgPC0gIm1zQWdncl9zZXVyYXQiCmphY2tzdHJhdy5kaW0gPC0gNDAKYGBgCgojIyBTdG9yZSBzZXNzaW9uIGluZm8KYGBge3J9CnNlc3Npb25JbmZvLmZpbGVuYW1lIDwtIHBhc3RlMChwcm9qZWN0TmFtZSwgIl9zZXNzaW9uSW5mby50eHQiKQpzaW5rKHNlc3Npb25JbmZvLmZpbGVuYW1lKQpzZXNzaW9uSW5mbygpCnNpbmsoKQpgYGAKCgpgYGB7cn0Kc291cmNlKCJ+L0Rlc2t0b3AvMTBYR2Vub21pY3NEYXRhL21zQWdncl9zY1JOQVNlcS9SRnVuY3Rpb25zL3JlYWRfMTBYR2Vub21pY3NfZGF0YS5SIikKc291cmNlKCJ+L0Rlc2t0b3AvMTBYR2Vub21pY3NEYXRhL21zQWdncl9zY1JOQVNlcS9SRnVuY3Rpb25zL1BlcmNlbnRWYXJpYW5jZS5SIikKc291cmNlKCJ+L0Rlc2t0b3AvMTBYR2Vub21pY3NEYXRhL21zQWdncl9zY1JOQVNlcS9SRnVuY3Rpb25zL0NvbG9yUGFsZXR0ZS5SIikKYGBgCgoKYGBge3Igd2FybmluZz1GQUxTRX0Kc2V0d2QoIn4vRGVza3RvcC8xMFhHZW5vbWljc0RhdGEvY2VsbFJhbmdlci8iKSAjIHRlbXBvcmFyaWx5IGNoYW5naW5nIHdkIG9ubHkgd29ya3MgaWYgeW91IHJ1biB0aGUgZW50aXJlIGNodW5rIGF0IG9uY2UKZGF0YV9maWxlLmxpc3QgPC0gcmVhZF8xMFhHZW5vbWljc19kYXRhKHNhbXBsZS5saXN0ID0gYygiTFNLbTIiLCAiQ01QbTIiLCAiTUVQbSIsICJHTVBtIikpCmRhdGEub2JqZWN0PC1SZWFkMTBYKGRhdGFfZmlsZS5saXN0KQpgYGAKCgoKYGBge3J9CnNldXJhdC5vYmplY3Q8LSBDcmVhdGVTZXVyYXRPYmplY3QoY291bnRzID0gZGF0YS5vYmplY3QsIG1pbi5jZWxscyA9IDMsIG1pbi5nZW5lcyA9IDIwMCwgcHJvamVjdCA9IHByb2plY3ROYW1lKQpgYGAKCkNsZWFuIHVwIHRvIGZyZWUgbWVtb3J5CgpgYGB7cn0KcmVtb3ZlKGRhdGEub2JqZWN0KQpgYGAKCgpBZGQgbWl0b2Nob25kcmlhbCBtZXRhZGF0YSBhbmQgcGxvdCBzb21lIGJhc2ljIGZlYXR1cmVzCmBgYHtyfQpzZXVyYXQub2JqZWN0W1sicGVyY2VudC5tdCJdXSA8LSBQZXJjZW50YWdlRmVhdHVyZVNldChzZXVyYXQub2JqZWN0LCBwYXR0ZXJuID0gIl5tdC0iKQpWbG5QbG90KHNldXJhdC5vYmplY3QsIGZlYXR1cmVzID0gYygibkZlYXR1cmVfUk5BIiwgIm5Db3VudF9STkEiLCAicGVyY2VudC5tdCIpLCBuY29sID0gMywgcHQuc2l6ZSA9IDAsIGZpbGwuYnkgPSAnb3JpZy5pZGVudCcsICkKYGBgCgoKYGBge3IgZmlnLndpZHRoPTQsIGZpZy5oZWlnaHQ9Mn0KcGxvdDEgPC0gRmVhdHVyZVNjYXR0ZXIoc2V1cmF0Lm9iamVjdCwgZmVhdHVyZTEgPSAibkNvdW50X1JOQSIsIGZlYXR1cmUyID0gInBlcmNlbnQubXQiLCBncm91cC5ieSA9ICJvcmlnLmlkZW50IiwgcHQuc2l6ZSA9IDAuMDEpCnBsb3QyIDwtIEZlYXR1cmVTY2F0dGVyKHNldXJhdC5vYmplY3QsIGZlYXR1cmUxID0gIm5Db3VudF9STkEiLCBmZWF0dXJlMiA9ICJuRmVhdHVyZV9STkEiLCBncm91cC5ieSA9ICJvcmlnLmlkZW50IiwgcHQuc2l6ZSA9IDAuMDEpCnBsb3QxICsgcGxvdDIKYGBgCgoKcmVtb3ZlIGxvdyBxdWFsaXR5IGNlbGxzCnJlcXVpcmU6IG5GZWF0dXJlX1JOQSBiZXR3ZWVuIDIwMCBhbmQgNDAwMCAoaW5jbHVzaXZlKQpyZXF1aXJlOiBwZXJjZW50Lm10IDw9IDUKCmBgYHtyfQpwcmludChwYXN0ZSgib3JpZ2luYWwgb2JqZWN0OiIsIG5yb3coc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEpLCAiY2VsbHMiLCBzZXAgPSAiICIpKQpzZXVyYXQub2JqZWN0IDwtIHN1YnNldChzZXVyYXQub2JqZWN0LCAKCQkJCQkJCQkJCQkJc3Vic2V0ID0gbkZlYXR1cmVfUk5BID49MjAwICYgCgkJCQkJCQkJCQkJCQluRmVhdHVyZV9STkEgPD0gNDAwMCAmIAoJCQkJCQkJCQkJCQkJcGVyY2VudC5tdCA8PSA1CgkJCQkJCQkJCQkJCSkKcHJpbnQocGFzdGUoIm5ldyBvYmplY3Q6IiwgbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YSksICJjZWxscyIsIHNlcCA9ICIgIikpCmBgYAoKCgojIyBOb3JtYWxpemF0aW9uCgpTdHJ1Z2dsaW5nIHRvIHdyYXAgbXkgaGVhZCBhcm91bmQgdGhpcyBvbmUuIEl0IHNlZW1zIHRoYXQgU0NUcmFuc2Zvcm0gaXMgYmVzdCBmb3IgYmF0Y2ggY29ycmVjdGlvbiwgYnV0IGBOb3JtYWxpemVEYXRhYCBhbmQgYFNjYWxlRGF0YWAgYXJlIGJlc3QgZm9yIERHRS4gU2V2ZXJhbCB2aWduZXR0ZXMgaGF2ZSBwZXJmb3JtZWQgYm90aAoKYHNlbGVjdGlvbi5tZXRob2QJCkhvdyB0byBjaG9vc2UgdG9wIHZhcmlhYmxlIGZlYXR1cmVzLiBDaG9vc2Ugb25lIG9mIDoKCnZzdDogRmlyc3QsIGZpdHMgYSBsaW5lIHRvIHRoZSByZWxhdGlvbnNoaXAgb2YgbG9nKHZhcmlhbmNlKSBhbmQgbG9nKG1lYW4pIHVzaW5nIGxvY2FsIHBvbHlub21pYWwgcmVncmVzc2lvbiAobG9lc3MpLiBUaGVuIHN0YW5kYXJkaXplcyB0aGUgZmVhdHVyZSB2YWx1ZXMgdXNpbmcgdGhlIG9ic2VydmVkIG1lYW4gYW5kIGV4cGVjdGVkIHZhcmlhbmNlIChnaXZlbiBieSB0aGUgZml0dGVkIGxpbmUpLiBGZWF0dXJlIHZhcmlhbmNlIGlzIHRoZW4gY2FsY3VsYXRlZCBvbiB0aGUgc3RhbmRhcmRpemVkIHZhbHVlcyBhZnRlciBjbGlwcGluZyB0byBhIG1heGltdW0gKHNlZSBjbGlwLm1heCBwYXJhbWV0ZXIpLgoKbWVhbi52YXIucGxvdCAobXZwKTogRmlyc3QsIHVzZXMgYSBmdW5jdGlvbiB0byBjYWxjdWxhdGUgYXZlcmFnZSBleHByZXNzaW9uIChtZWFuLmZ1bmN0aW9uKSBhbmQgZGlzcGVyc2lvbiAoZGlzcGVyc2lvbi5mdW5jdGlvbikgZm9yIGVhY2ggZmVhdHVyZS4gTmV4dCwgZGl2aWRlcyBmZWF0dXJlcyBpbnRvIG51bS5iaW4gKGRlYWZ1bHQgMjApIGJpbnMgYmFzZWQgb24gdGhlaXIgYXZlcmFnZSBleHByZXNzaW9uLCBhbmQgY2FsY3VsYXRlcyB6LXNjb3JlcyBmb3IgZGlzcGVyc2lvbiB3aXRoaW4gZWFjaCBiaW4uIFRoZSBwdXJwb3NlIG9mIHRoaXMgaXMgdG8gaWRlbnRpZnkgdmFyaWFibGUgZmVhdHVyZXMgd2hpbGUgY29udHJvbGxpbmcgZm9yIHRoZSBzdHJvbmcgcmVsYXRpb25zaGlwIGJldHdlZW4gdmFyaWFiaWxpdHkgYW5kIGF2ZXJhZ2UgZXhwcmVzc2lvbi4KCmRpc3BlcnNpb24gKGRpc3ApOiBzZWxlY3RzIHRoZSBnZW5lcyB3aXRoIHRoZSBoaWdoZXN0IGRpc3BlcnNpb24gdmFsdWVzYAoKCgoKYGBge3J9CnNldXJhdC5vYmplY3QgPC0gTm9ybWFsaXplRGF0YShzZXVyYXQub2JqZWN0LCBub3JtYWxpemF0aW9uLm1ldGhvZCA9ICJMb2dOb3JtYWxpemUiLCBzY2FsZS5mYWN0b3IgPSAxMDAwMCkKYGBgCgoKCgoKRmluZCB2YXJpYWJsZSBmZWF0dXJlcwpgYGB7ciBmaWcud2lkdGggPSA1LCBmaWcuaGVpZ2h0ID0gMn0Kc2V1cmF0Lm9iamVjdCA8LSBGaW5kVmFyaWFibGVGZWF0dXJlcyhzZXVyYXQub2JqZWN0LCBzZWxlY3Rpb24ubWV0aG9kID0gInZzdCIsIG5mZWF0dXJlcyA9IDIwMDApCnRvcDEwIDwtIGhlYWQoVmFyaWFibGVGZWF0dXJlcyhzZXVyYXQub2JqZWN0KSwgMTApCnBsb3QxIDwtIFZhcmlhYmxlRmVhdHVyZVBsb3Qoc2V1cmF0Lm9iamVjdCkKcGxvdDIgPC0gTGFiZWxQb2ludHMocGxvdCA9IHBsb3QxLCBwb2ludHMgPSB0b3AxMCwgcmVwZWwgPSBUUlVFKQpwbG90MSArIHBsb3QyCmBgYAoKU2NhbGUgZGF0YSAobGluZWFyIHRyYW5zZm9ybWF0aW9uKQoKYGBge3J9CmFsbC5nZW5lcyA8LSByb3duYW1lcyhzZXVyYXQub2JqZWN0KQpzZXVyYXQub2JqZWN0IDwtIFNjYWxlRGF0YShzZXVyYXQub2JqZWN0LCBmZWF0dXJlcyA9IGFsbC5nZW5lcywgdmFycy50by5yZWdyZXNzID0gYygibkNvdW50X1JOQSIsICJuRmVhdHVyZV9STkEiKSkKYGBgCgoKIyMjIFNhdmUgcHJvZ3Jlc3MKCmBgYHtyfQojIHNhdmUuaW1hZ2UoZmlsZSA9IHBhc3RlMChwcm9qZWN0TmFtZSwgJy5SRGF0YScpKQpzYXZlUkRTKHNldXJhdC5vYmplY3QsIGZpbGUgPSBwYXN0ZTAocHJvamVjdE5hbWUsICJfcmF3LlJEUyIpKQpgYGAKCgojIyBQQ0EKCmxpbmVhciBkaW1lbnNpb25hbCByZWR1Y3Rpb24uIERlZmF1bHQgYXJlIGJhc2VkIG9uIFZhcmlhYmxlRmVhdHVyZXMsIGJ1dCBjYW4gYmUgY2hhbmdlZAoKYGBge3J9CnNldXJhdC5vYmplY3QgPC0gUnVuUENBKHNldXJhdC5vYmplY3QsIGZlYXR1cmVzID0gVmFyaWFibGVGZWF0dXJlcyhvYmplY3QgPSBzZXVyYXQub2JqZWN0KSkKYGBgClBsb3QgcmVzdWx0cwpgYGB7ciBmaWcud2lkdGg9NCwgZmlnLmhlaWdodD00fQpWaXpEaW1Mb2FkaW5ncyhzZXVyYXQub2JqZWN0LCBkaW1zID0gMTo2LCBuZmVhdHVyZXMgPSAxMCwgcmVkdWN0aW9uID0gInBjYSIsIG5jb2wgPSAyKQpgYGAKCkRpbVBsb3QgY29sb3JlZCBieSBvcmlnLmlkZW50CmBgYHtyfQpEaW1QbG90KHNldXJhdC5vYmplY3QsIHJlZHVjdGlvbiA9ICJwY2EiLCBncm91cC5ieSA9ICJvcmlnLmlkZW50IikKYGBgCkxldCdzIHB1dCBpbiBhIGNvbmNlcnRlZCBlZmZvcnQgdG8gcGljayB0aGUgcmlnaHQgZGltZW5zaW9uYWxpdHkgdXNpbmcgdGhlIG5ld2VzdCBzb2Z0d2FyZQpgYGB7cn0KIyBqYWNrc3RyYXcuZGltIDwtIDQwCiMgc2V1cmF0Lm9iamVjdCA8LSBKYWNrU3RyYXcoc2V1cmF0Lm9iamVjdCwgbnVtLnJlcGxpY2F0ZSA9IDEwMCwgZGltcyA9IGphY2tzdHJhdy5kaW0pICNydW5zIH41MCBtaW4KIyBzZXVyYXQub2JqZWN0IDwtIFNjb3JlSmFja1N0cmF3KHNldXJhdC5vYmplY3QsIGRpbXMgPSAxOmphY2tzdHJhdy5kaW0pCiMgc2F2ZS5pbWFnZShwYXN0ZTAocHJvamVjdE5hbWUsICIuUkRhdGEiKSkKYGBgCkRyYXcgZGltLnJlZHVjdGlvbiBwbG90cwpgYGB7cn0KIyBKYWNrU3RyYXdQbG90KHNldXJhdC5vYmplY3QsIGRpbXMgPSAyNTozNikKYGBgCmBgYHtyLCBmaWd1cmVzLXNpZGUsIGZpZy5zaG93PSdob2xkJywgb3V0LndpZHRoPSI1MCUifQpFbGJvd1Bsb3Qoc2V1cmF0Lm9iamVjdCwgbmRpbXMgPSA1MCkKcGVyY2VudC52YXJpYW5jZShzZXVyYXQub2JqZWN0QHJlZHVjdGlvbnMkcGNhQHN0ZGV2KQpgYGAKTnVtYmVyIG9mIFBDcyBkZXNjcmliaW5nIFglIG9mIHZhcmlhbmNlCmBgYHtyfQp0b3QudmFyIDwtIHBlcmNlbnQudmFyaWFuY2Uoc2V1cmF0Lm9iamVjdEByZWR1Y3Rpb25zJHBjYUBzdGRldiwgcGxvdC52YXIgPSBGQUxTRSwgcmV0dXJuLnZhbCA9IFRSVUUpCnBhc3RlMCgiTnVtIHBjcyBmb3IgODAlIHZhcmlhbmNlOiAiLCBsZW5ndGgod2hpY2goY3Vtc3VtKHRvdC52YXIpIDw9IDgwKSkpCnBhc3RlMCgiTnVtIHBjcyBmb3IgODUlIHZhcmlhbmNlOiAiLCBsZW5ndGgod2hpY2goY3Vtc3VtKHRvdC52YXIpIDw9IDg1KSkpCnBhc3RlMCgiTnVtIHBjcyBmb3IgOTAlIHZhcmlhbmNlOiAiLCBsZW5ndGgod2hpY2goY3Vtc3VtKHRvdC52YXIpIDw9IDkwKSkpCnBhc3RlMCgiTnVtIHBjcyBmb3IgOTUlIHZhcmlhbmNlOiAiLCBsZW5ndGgod2hpY2goY3Vtc3VtKHRvdC52YXIpIDw9IDk1KSkpCgpgYGAKClBlcmNlbnQgb2YgUENzIGRlc2NyaWJpbmcgWCUgb2YgdmFyaWFuY2UgKHRyYW5zY3JpYmVkIGZyb20gYWJvdmUgY2VsbCBiZWNhdXNlIEkgZG9uJ3Qga25vdyBob3cgdG8gZnJlZXplIHJlc3VsdHMpCgpOdW0gcGNzIGZvciA4MCUgdmFyaWFuY2U6IDEyCk51bSBwY3MgZm9yIDg1JSB2YXJpYW5jZTogMTgKTnVtIHBjcyBmb3IgOTAlIHZhcmlhbmNlOiAyNgpOdW0gcGNzIGZvciA5NSUgdmFyaWFuY2U6IDM3CgojIElEIGNsdXN0ZXJzIGJhc2VkIG9uIGRpZmZlcmVudCB2YXJpYW5jZXMKIyMgRGVzY3JpYmUgODAlIG9mIHZhcmlhbmNlIHdpdGggMTIgZGltZW5zaW9ucwoKIyMjIE5laWdoYm9yaG9vZCBhbmQgdW1hcApzZXQgdG90YWwudmFyIDwtIDgwJQpgYGB7cn0KdG90LnZhciA8LSBwZXJjZW50LnZhcmlhbmNlKHNldXJhdC5vYmplY3RAcmVkdWN0aW9ucyRwY2FAc3RkZXYsIHBsb3QudmFyID0gRkFMU0UsIHJldHVybi52YWwgPSBUUlVFKQpuZGltcyA8LSBsZW5ndGgod2hpY2goY3Vtc3VtKHRvdC52YXIpIDw9IDgwKSkKCnNldXJhdC5vYmplY3QgPC0gRmluZE5laWdoYm9ycyhzZXVyYXQub2JqZWN0LCBkaW1zID0gMTpuZGltcykKc2V1cmF0Lm9iamVjdCA8LSBGaW5kQ2x1c3RlcnMoc2V1cmF0Lm9iamVjdCwgcmVzb2x1dGlvbiA9IDAuNSkKc2V1cmF0Lm9iamVjdCA8LSBSdW5VTUFQKHNldXJhdC5vYmplY3QsIGRpbXMgPSAxOiBuZGltcykKCmBgYApQbG90IFVNQVAKCmBgYHtyfQpmb3IoeCBpbiBjKDAuNSwgMSwgMS41LCAyLCAyLjUpKXsKCXNldXJhdC5vYmplY3QgPC0gRmluZENsdXN0ZXJzKHNldXJhdC5vYmplY3QsIHJlc29sdXRpb24gPSB4KQp9CmBgYAoKYGBge3J9CmZvciAobWV0YS5jb2wgaW4gY29sbmFtZXMoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEpKXsKCWlmKGdyZXBsKHBhdHRlcm4gPSAoIlJOQV9zbm5fcmVzIiksIHggPSBtZXRhLmNvbCk9PVRSVUUpewoJCW15cGxvdCA8LSBEaW1QbG90KHNldXJhdC5vYmplY3QsIAoJCQkJCQkJCQkJCWdyb3VwLmJ5ID0gbWV0YS5jb2wsCgkJCQkJCQkJCQkJcmVkdWN0aW9uID0gInVtYXAiLCAKCQkJCQkJCQkJCQljb2xzID0gY29sb3IucGFsZXR0ZQoJCQkJCQkJCQkJCSkgKyAKCQkJZ2d0aXRsZShwYXN0ZTAocHJvamVjdE5hbWUsICIgZGltIiwgbmRpbXMsICJyZXMiLCBnc3ViKCJSTkFfc25uX3JlcyIsICIiLCBtZXRhLmNvbCkgKSkKCQlwbG90KG15cGxvdCkKCX0KfQpgYGAKCmBgYHtyfQpzYXZlUkRTKHNldXJhdC5vYmplY3QsIGZpbGUgPSBwYXN0ZTAocHJvamVjdE5hbWUsICJfZGltIiwgbmRpbXMsICIuUkRTIikpCmBgYAoKR2VuZXJhdGUgc3RhdGlzdGljcyBmb3IgZWFjaCBjbHVzdGVyL3Jlc29sdXRpb24gY29tYm8KYGBge3J9CmN1cnJlbnRfcmVzIDwtICdSTkFfc25uX3Jlcy4wLjUnCgpjbHVzdGVyX2lkcyA8LSBzb3J0KHVuaXF1ZShzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVssY3VycmVudF9yZXNdKSkKY291bnRzX2RmIDwtIGRhdGEuZnJhbWUobWF0cml4KG5yb3cgPSBsZW5ndGgoY2x1c3Rlcl9pZHMpLCBuY29sID0gNCkpCnJvd25hbWVzKGNvdW50c19kZikgPC0gY2x1c3Rlcl9pZHMKY29sbmFtZXMoY291bnRzX2RmKSA8LSBjKCJMU0ttMiIsICJDTVBtMiIsICJNRVBtIiwgIkdNUG0iKQpmb3IoaWQgaW4gY2x1c3Rlcl9pZHMpewoJY2VsbF92YWx1ZSA8LSBucm93KHNldXJhdC5vYmplY3RAbWV0YS5kYXRhWyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVtjdXJyZW50X3Jlc10gPT0gaWQpICYgCgkJCQkJCQkJCQkJCQkJCQkJCQkJCQkgCShzZXVyYXQub2JqZWN0QG1ldGEuZGF0YSRvcmlnLmlkZW50ID09ICJMU0ttMiIpLF0pCgljb3VudHNfZGZbaWQsICJMU0ttMiJdID0gY2VsbF92YWx1ZQoJY2VsbF92YWx1ZSA8LSBucm93KHNldXJhdC5vYmplY3RAbWV0YS5kYXRhWyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVtjdXJyZW50X3Jlc10gPT0gaWQpICYgCgkJCQkJCQkJCQkJCQkJCQkJCQkJCQkgCShzZXVyYXQub2JqZWN0QG1ldGEuZGF0YSRvcmlnLmlkZW50ID09ICJMU0ttMiIpLF0pCgljb3VudHNfZGZbaWQsICJDTVBtMiJdID0gY2VsbF92YWx1ZQoJY2VsbF92YWx1ZSA8LSBucm93KHNldXJhdC5vYmplY3RAbWV0YS5kYXRhWyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVtjdXJyZW50X3Jlc10gPT0gaWQpICYgCgkJCQkJCQkJCQkJCQkJCQkJCQkJCQkgCShzZXVyYXQub2JqZWN0QG1ldGEuZGF0YSRvcmlnLmlkZW50ID09ICJNRVBtIiksXSkKCWNvdW50c19kZltpZCwgIk1FUG0iXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiR01QbSIpLF0pCgljb3VudHNfZGZbaWQsICJHTVBtIl0gPSBjZWxsX3ZhbHVlCgp9CgpgYGAKCgojIyMgRXZhbHVhdGUgY2x1c3RlciBzdGFiaWxpdHkKYGBge3IgZmlnLmhlaWdodD01fQpjbHVzdHJlZShzZXVyYXQub2JqZWN0LCBwcmVmaXggPSAiUk5BX3Nubl9yZXMuIiwgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmBgYAoKCgpgYGB7ciBmaWcuaGVpZ2h0PTV9CmNsdXN0cmVlKHNldXJhdC5vYmplY3QsIHByZWZpeCA9ICJSTkFfc25uX3Jlcy4iLCBleHByZXMgPSAnZGF0YScsIG5vZGVfY29sb3VyID0gInNjM19zdGFiaWxpdHkiKSArIAoJc2NhbGVfY29sb3JfY29udGludW91cyhsb3cgPSAncmVkMycsIGhpZ2ggPSAnd2hpdGUnKQpgYGAKCgpgYGB7ciBmaWcuaGVpZ2h0PTV9CmNsdXN0cmVlKHNldXJhdC5vYmplY3QsIHByZWZpeCA9ICJSTkFfc25uX3Jlcy4iLCBleHByZXMgPSAnc2NhbGUuZGF0YScsIG5vZGVfY29sb3VyID0gInNjM19zdGFiaWxpdHkiKSArIAoJc2NhbGVfY29sb3JfY29udGludW91cyhsb3cgPSAncmVkMycsIGhpZ2ggPSAnd2hpdGUnKQpgYGAKCgoKYGBge3IgZmlnLmhlaWdodD01fQpjbHVzdHJlZShzZXVyYXQub2JqZWN0LCBwcmVmaXggPSAiUk5BX3Nubl9yZXMuIiwgZXhwcmVzID0gJ2NvdW50cycsIG5vZGVfY29sb3VyID0gInNjM19zdGFiaWxpdHkiKSArIAoJc2NhbGVfY29sb3JfY29udGludW91cyhsb3cgPSAncmVkMycsIGhpZ2ggPSAnd2hpdGUnKQpgYGAKCgoKCgoKCgoKCgoKCiMjIERlc2NyaWJlIDg1JSBvZiB2YXJpYW5jZSB3aXRoIDE4IGRpbWVuc2lvbnMKCiMjIyBOZWlnaGJvcmhvb2QgYW5kIHVtYXAKc2V0IHRvdGFsLnZhciA8LSA4NSUKYGBge3J9CnRvdC52YXIgPC0gcGVyY2VudC52YXJpYW5jZShzZXVyYXQub2JqZWN0QHJlZHVjdGlvbnMkcGNhQHN0ZGV2LCBwbG90LnZhciA9IEZBTFNFLCByZXR1cm4udmFsID0gVFJVRSkKbmRpbXMgPC0gbGVuZ3RoKHdoaWNoKGN1bXN1bSh0b3QudmFyKSA8PSA4NSkpCgpzZXVyYXQub2JqZWN0IDwtIEZpbmROZWlnaGJvcnMoc2V1cmF0Lm9iamVjdCwgZGltcyA9IDE6bmRpbXMpCnNldXJhdC5vYmplY3QgPC0gRmluZENsdXN0ZXJzKHNldXJhdC5vYmplY3QsIHJlc29sdXRpb24gPSAwLjUpCnNldXJhdC5vYmplY3QgPC0gUnVuVU1BUChzZXVyYXQub2JqZWN0LCBkaW1zID0gMTogbmRpbXMpCgpgYGAKUGxvdCBVTUFQCgpgYGB7cn0KZm9yKHggaW4gYygwLjUsIDEsIDEuNSwgMiwgMi41KSl7CglzZXVyYXQub2JqZWN0IDwtIEZpbmRDbHVzdGVycyhzZXVyYXQub2JqZWN0LCByZXNvbHV0aW9uID0geCkKfQpgYGAKCmBgYHtyfQpmb3IgKG1ldGEuY29sIGluIGNvbG5hbWVzKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhKSl7CglpZihncmVwbChwYXR0ZXJuID0gKCJSTkFfc25uX3JlcyIpLCB4ID0gbWV0YS5jb2wpPT1UUlVFKXsKCQlteXBsb3QgPC0gRGltUGxvdChzZXVyYXQub2JqZWN0LCAKCQkJCQkJCQkJCQlncm91cC5ieSA9IG1ldGEuY29sLAoJCQkJCQkJCQkJCXJlZHVjdGlvbiA9ICJ1bWFwIiwgCgkJCQkJCQkJCQkJY29scyA9IGNvbG9yLnBhbGV0dGUKCQkJCQkJCQkJCQkpICsgCgkJCWdndGl0bGUocGFzdGUwKHByb2plY3ROYW1lLCAiIGRpbSIsIG5kaW1zLCAicmVzIiwgZ3N1YigiUk5BX3Nubl9yZXMiLCAiIiwgbWV0YS5jb2wpICkpCgkJcGxvdChteXBsb3QpCgl9Cn0KYGBgCgpgYGB7cn0Kc2F2ZVJEUyhzZXVyYXQub2JqZWN0LCBmaWxlID0gcGFzdGUwKHByb2plY3ROYW1lLCAiX2RpbSIsIG5kaW1zLCAiLlJEUyIpKQpgYGAKCkdlbmVyYXRlIHN0YXRpc3RpY3MgZm9yIGVhY2ggY2x1c3Rlci9yZXNvbHV0aW9uIGNvbWJvCmBgYHtyfQpjdXJyZW50X3JlcyA8LSAnUk5BX3Nubl9yZXMuMC41JwoKY2x1c3Rlcl9pZHMgPC0gc29ydCh1bmlxdWUoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbLGN1cnJlbnRfcmVzXSkpCmNvdW50c19kZiA8LSBkYXRhLmZyYW1lKG1hdHJpeChucm93ID0gbGVuZ3RoKGNsdXN0ZXJfaWRzKSwgbmNvbCA9IDQpKQpyb3duYW1lcyhjb3VudHNfZGYpIDwtIGNsdXN0ZXJfaWRzCmNvbG5hbWVzKGNvdW50c19kZikgPC0gYygiTFNLbTIiLCAiQ01QbTIiLCAiTUVQbSIsICJHTVBtIikKZm9yKGlkIGluIGNsdXN0ZXJfaWRzKXsKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTFNLbTIiKSxdKQoJY291bnRzX2RmW2lkLCAiTFNLbTIiXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTFNLbTIiKSxdKQoJY291bnRzX2RmW2lkLCAiQ01QbTIiXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTUVQbSIpLF0pCgljb3VudHNfZGZbaWQsICJNRVBtIl0gPSBjZWxsX3ZhbHVlCgljZWxsX3ZhbHVlIDwtIG5yb3coc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhW2N1cnJlbnRfcmVzXSA9PSBpZCkgJiAKCQkJCQkJCQkJCQkJCQkJCQkJCQkJCSAJKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhJG9yaWcuaWRlbnQgPT0gIkdNUG0iKSxdKQoJY291bnRzX2RmW2lkLCAiR01QbSJdID0gY2VsbF92YWx1ZQoKfQoKYGBgCgoKIyMjIEV2YWx1YXRlIGNsdXN0ZXIgc3RhYmlsaXR5Ck11c3QgZW5zdXJlIHdlIGhhdmUgdGhlIHJpZ2h0IGNsdXN0ZXIgc3RhYmlsaXR5LCB0aGF0IGlzLCBjZWxscyB0aGF0IHN0YXJ0IGluIHRoZSBzYW1lIGNsdXN0ZXIgdGVuZCB0byBzdGF5IGluIHRoZSBzYW1lIGNsdXN0ZXIuIElmIHlvdXIgZGF0YSBpcyBvdmVyLWNsdXN0ZXJlZCwgY2VsbHMgd2lsbCBib3VuY2UgYmV0d2VlbiBncm91cHMuCgpGb2xsb3dpbmcgW3RoaXMgdHV0b3JpYWwgYnkgTWF0dCBPLl0uaHR0cHM6Ly90b3dhcmRzZGF0YXNjaWVuY2UuY29tLzEwLXRpcHMtZm9yLWNob29zaW5nLXRoZS1vcHRpbWFsLW51bWJlci1vZi1jbHVzdGVycy0yNzdlOTNkNzJkOTIuClByZXZpb3VzbHkgbXkgZmF2b3VyaXRlIGhhcyBiZWVuIENsdXN0cmVlLCB3aGljaCBnaXZlcyBhIG5pY2UgdmlzdWFsCk5COiBGb3Igc29tZSByZWFzb24gYGNsdXN0cmVlOjpjbHVzdHJlZSgpYCBkaWRuJ3Qgd29yaywgd2hlcmVhcyBgbGlicmFyeShjbHVzdHJlZSlgIGZvbGxvd2VkIGJ5IGBjbHVzdHJlZSgpYCBkaWQuCgpgYGB7ciBmaWcuaGVpZ2h0PTV9CmNsdXN0cmVlKHNldXJhdC5vYmplY3QsIHByZWZpeCA9ICJSTkFfc25uX3Jlcy4iLCBub2RlX2NvbG91ciA9ICJzYzNfc3RhYmlsaXR5IikgKyAKCXNjYWxlX2NvbG9yX2NvbnRpbnVvdXMobG93ID0gJ3JlZDMnLCBoaWdoID0gJ3doaXRlJykKYGBgCgoKCmBgYHtyIGZpZy5oZWlnaHQ9NX0KY2x1c3RyZWUoc2V1cmF0Lm9iamVjdCwgcHJlZml4ID0gIlJOQV9zbm5fcmVzLiIsIGV4cHJlcyA9ICdkYXRhJywgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmBgYAoKCmBgYHtyIGZpZy5oZWlnaHQ9NX0KY2x1c3RyZWUoc2V1cmF0Lm9iamVjdCwgcHJlZml4ID0gIlJOQV9zbm5fcmVzLiIsIGV4cHJlcyA9ICdzY2FsZS5kYXRhJywgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmBgYAoKCgpgYGB7ciBmaWcuaGVpZ2h0PTV9CmNsdXN0cmVlKHNldXJhdC5vYmplY3QsIHByZWZpeCA9ICJSTkFfc25uX3Jlcy4iLCBleHByZXMgPSAnY291bnRzJywgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmBgYAoKCgoKCgoKCgoKCiMjIERlc2NyaWJlIDkwJSBvZiB2YXJpYW5jZSB3aXRoIDI2IGRpbWVuc2lvbnMKCiMjIyBOZWlnaGJvcmhvb2QgYW5kIHVtYXAKYGBge3J9CnRvdC52YXIgPC0gcGVyY2VudC52YXJpYW5jZShzZXVyYXQub2JqZWN0QHJlZHVjdGlvbnMkcGNhQHN0ZGV2LCBwbG90LnZhciA9IEZBTFNFLCByZXR1cm4udmFsID0gVFJVRSkKbmRpbXMgPC0gbGVuZ3RoKHdoaWNoKGN1bXN1bSh0b3QudmFyKSA8PSA5MCkpCgpzZXVyYXQub2JqZWN0IDwtIEZpbmROZWlnaGJvcnMoc2V1cmF0Lm9iamVjdCwgZGltcyA9IDE6bmRpbXMpCnNldXJhdC5vYmplY3QgPC0gRmluZENsdXN0ZXJzKHNldXJhdC5vYmplY3QsIHJlc29sdXRpb24gPSAwLjUpCnNldXJhdC5vYmplY3QgPC0gUnVuVU1BUChzZXVyYXQub2JqZWN0LCBkaW1zID0gMTogbmRpbXMpCgpgYGAKUGxvdCBVTUFQCgpgYGB7cn0KZm9yKHggaW4gYygwLjUsIDEsIDEuNSwgMiwgMi41KSl7CglzZXVyYXQub2JqZWN0IDwtIEZpbmRDbHVzdGVycyhzZXVyYXQub2JqZWN0LCByZXNvbHV0aW9uID0geCkKfQpgYGAKCmBgYHtyfQpmb3IgKG1ldGEuY29sIGluIGNvbG5hbWVzKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhKSl7CglpZihncmVwbChwYXR0ZXJuID0gKCJSTkFfc25uX3JlcyIpLCB4ID0gbWV0YS5jb2wpPT1UUlVFKXsKCQlteXBsb3QgPC0gRGltUGxvdChzZXVyYXQub2JqZWN0LCAKCQkJCQkJCQkJCQlncm91cC5ieSA9IG1ldGEuY29sLAoJCQkJCQkJCQkJCXJlZHVjdGlvbiA9ICJ1bWFwIiwgCgkJCQkJCQkJCQkJY29scyA9IGNvbG9yLnBhbGV0dGUKCQkJCQkJCQkJCQkpICsgCgkJCWdndGl0bGUocGFzdGUwKHByb2plY3ROYW1lLCAiIGRpbSIsIG5kaW1zLCAicmVzIiwgZ3N1YigiUk5BX3Nubl9yZXMiLCAiIiwgbWV0YS5jb2wpICkpCgkJcGxvdChteXBsb3QpCgl9Cn0KYGBgCgpgYGB7cn0Kc2F2ZVJEUyhzZXVyYXQub2JqZWN0LCBmaWxlID0gcGFzdGUwKHByb2plY3ROYW1lLCAiX2RpbSIsIG5kaW1zLCAiLlJEUyIpKQpgYGAKCkdlbmVyYXRlIHN0YXRpc3RpY3MgZm9yIGVhY2ggY2x1c3Rlci9yZXNvbHV0aW9uIGNvbWJvCmBgYHtyfQpjdXJyZW50X3JlcyA8LSAnUk5BX3Nubl9yZXMuMC41JwoKY2x1c3Rlcl9pZHMgPC0gc29ydCh1bmlxdWUoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbLGN1cnJlbnRfcmVzXSkpCmNvdW50c19kZiA8LSBkYXRhLmZyYW1lKG1hdHJpeChucm93ID0gbGVuZ3RoKGNsdXN0ZXJfaWRzKSwgbmNvbCA9IDQpKQpyb3duYW1lcyhjb3VudHNfZGYpIDwtIGNsdXN0ZXJfaWRzCmNvbG5hbWVzKGNvdW50c19kZikgPC0gYygiTFNLbTIiLCAiQ01QbTIiLCAiTUVQbSIsICJHTVBtIikKZm9yKGlkIGluIGNsdXN0ZXJfaWRzKXsKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTFNLbTIiKSxdKQoJY291bnRzX2RmW2lkLCAiTFNLbTIiXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTFNLbTIiKSxdKQoJY291bnRzX2RmW2lkLCAiQ01QbTIiXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTUVQbSIpLF0pCgljb3VudHNfZGZbaWQsICJNRVBtIl0gPSBjZWxsX3ZhbHVlCgljZWxsX3ZhbHVlIDwtIG5yb3coc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhW2N1cnJlbnRfcmVzXSA9PSBpZCkgJiAKCQkJCQkJCQkJCQkJCQkJCQkJCQkJCSAJKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhJG9yaWcuaWRlbnQgPT0gIkdNUG0iKSxdKQoJY291bnRzX2RmW2lkLCAiR01QbSJdID0gY2VsbF92YWx1ZQoKfQoKYGBgCgoKIyMjIEV2YWx1YXRlIGNsdXN0ZXIgc3RhYmlsaXR5CmBgYHtyIGZpZy5oZWlnaHQ9NX0KY2x1c3RyZWUoc2V1cmF0Lm9iamVjdCwgcHJlZml4ID0gIlJOQV9zbm5fcmVzLiIsIG5vZGVfY29sb3VyID0gInNjM19zdGFiaWxpdHkiKSArIAoJc2NhbGVfY29sb3JfY29udGludW91cyhsb3cgPSAncmVkMycsIGhpZ2ggPSAnd2hpdGUnKQpwbmcoZmlsZW5hbWUgPSBwYXN0ZTAocHJvamVjdE5hbWUsICJfZGltIiwgbmRpbXMsICItY2x1c3RyZWUucG5nIiksIGhlaWdodCA9IDgwMCwgd2lkdGggPSAxNjAwKQpjbHVzdHJlZShzZXVyYXQub2JqZWN0LCBwcmVmaXggPSAiUk5BX3Nubl9yZXMuIiwgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmRldi5vZmYoKQpgYGAKYGBge3IgZmlnLmhlaWdodD01fQpjbHVzdHJlZShzZXVyYXQub2JqZWN0LCBwcmVmaXggPSAiUk5BX3Nubl9yZXMuIiwgZXhwcmVzID0gJ2RhdGEnLCBub2RlX2NvbG91ciA9ICJzYzNfc3RhYmlsaXR5IikgKyAKCXNjYWxlX2NvbG9yX2NvbnRpbnVvdXMobG93ID0gJ3JlZDMnLCBoaWdoID0gJ3doaXRlJykKYGBgCmBgYHtyIGZpZy5oZWlnaHQ9NX0KY2x1c3RyZWUoc2V1cmF0Lm9iamVjdCwgcHJlZml4ID0gIlJOQV9zbm5fcmVzLiIsIGV4cHJlcyA9ICdzY2FsZS5kYXRhJywgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmBgYApgYGB7ciBmaWcuaGVpZ2h0PTV9CmNsdXN0cmVlKHNldXJhdC5vYmplY3QsIHByZWZpeCA9ICJSTkFfc25uX3Jlcy4iLCBleHByZXMgPSAnY291bnRzJywgbm9kZV9jb2xvdXIgPSAic2MzX3N0YWJpbGl0eSIpICsgCglzY2FsZV9jb2xvcl9jb250aW51b3VzKGxvdyA9ICdyZWQzJywgaGlnaCA9ICd3aGl0ZScpCmBgYAojIERlc2NyaWJlIDk1JSBvZiB2YXJpYW5jZSB3aXRoIDM3IGRpbWVuc2lvbnMKCiMjIyBOZWlnaGJvcmhvb2QgYW5kIHVtYXAKYGBge3J9CnRvdC52YXIgPC0gcGVyY2VudC52YXJpYW5jZShzZXVyYXQub2JqZWN0QHJlZHVjdGlvbnMkcGNhQHN0ZGV2LCBwbG90LnZhciA9IEZBTFNFLCByZXR1cm4udmFsID0gVFJVRSkKbmRpbXMgPC0gbGVuZ3RoKHdoaWNoKGN1bXN1bSh0b3QudmFyKSA8PSA5NSkpCgpzZXVyYXQub2JqZWN0IDwtIEZpbmROZWlnaGJvcnMoc2V1cmF0Lm9iamVjdCwgZGltcyA9IDE6bmRpbXMpCnNldXJhdC5vYmplY3QgPC0gRmluZENsdXN0ZXJzKHNldXJhdC5vYmplY3QsIHJlc29sdXRpb24gPSAwLjUpCnNldXJhdC5vYmplY3QgPC0gUnVuVU1BUChzZXVyYXQub2JqZWN0LCBkaW1zID0gMTogbmRpbXMpCgpgYGAKUGxvdCBVTUFQCgpgYGB7cn0KZm9yKHggaW4gYygwLjUsIDEsIDEuNSwgMiwgMi41KSl7CglzZXVyYXQub2JqZWN0IDwtIEZpbmRDbHVzdGVycyhzZXVyYXQub2JqZWN0LCByZXNvbHV0aW9uID0geCkKfQpgYGAKCmBgYHtyfQpmb3IgKG1ldGEuY29sIGluIGNvbG5hbWVzKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhKSl7CglpZihncmVwbChwYXR0ZXJuID0gKCJSTkFfc25uX3JlcyIpLCB4ID0gbWV0YS5jb2wpPT1UUlVFKXsKCQlteXBsb3QgPC0gRGltUGxvdChzZXVyYXQub2JqZWN0LCAKCQkJCQkJCQkJCQlncm91cC5ieSA9IG1ldGEuY29sLAoJCQkJCQkJCQkJCXJlZHVjdGlvbiA9ICJ1bWFwIiwgCgkJCQkJCQkJCQkJY29scyA9IGNvbG9yLnBhbGV0dGUKCQkJCQkJCQkJCQkpICsgCgkJCWdndGl0bGUocGFzdGUwKHByb2plY3ROYW1lLCAiIGRpbSIsIG5kaW1zLCAicmVzIiwgZ3N1YigiUk5BX3Nubl9yZXMiLCAiIiwgbWV0YS5jb2wpICkpCgkJcGxvdChteXBsb3QpCgl9Cn0KYGBgCgpgYGB7cn0Kc2F2ZVJEUyhzZXVyYXQub2JqZWN0LCBmaWxlID0gcGFzdGUwKHByb2plY3ROYW1lLCAiX2RpbSIsIG5kaW1zLCAiLlJEUyIpKQpgYGAKCkdlbmVyYXRlIHN0YXRpc3RpY3MgZm9yIGVhY2ggY2x1c3Rlci9yZXNvbHV0aW9uIGNvbWJvCmBgYHtyfQpjdXJyZW50X3JlcyA8LSAnUk5BX3Nubl9yZXMuMC41JwoKY2x1c3Rlcl9pZHMgPC0gc29ydCh1bmlxdWUoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbLGN1cnJlbnRfcmVzXSkpCmNvdW50c19kZiA8LSBkYXRhLmZyYW1lKG1hdHJpeChucm93ID0gbGVuZ3RoKGNsdXN0ZXJfaWRzKSwgbmNvbCA9IDQpKQpyb3duYW1lcyhjb3VudHNfZGYpIDwtIGNsdXN0ZXJfaWRzCmNvbG5hbWVzKGNvdW50c19kZikgPC0gYygiTFNLbTIiLCAiQ01QbTIiLCAiTUVQbSIsICJHTVBtIikKZm9yKGlkIGluIGNsdXN0ZXJfaWRzKXsKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTFNLbTIiKSxdKQoJY291bnRzX2RmW2lkLCAiTFNLbTIiXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTFNLbTIiKSxdKQoJY291bnRzX2RmW2lkLCAiQ01QbTIiXSA9IGNlbGxfdmFsdWUKCWNlbGxfdmFsdWUgPC0gbnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVsoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbY3VycmVudF9yZXNdID09IGlkKSAmIAoJCQkJCQkJCQkJCQkJCQkJCQkJCQkJIAkoc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGEkb3JpZy5pZGVudCA9PSAiTUVQbSIpLF0pCgljb3VudHNfZGZbaWQsICJNRVBtIl0gPSBjZWxsX3ZhbHVlCgljZWxsX3ZhbHVlIDwtIG5yb3coc2V1cmF0Lm9iamVjdEBtZXRhLmRhdGFbKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhW2N1cnJlbnRfcmVzXSA9PSBpZCkgJiAKCQkJCQkJCQkJCQkJCQkJCQkJCQkJCSAJKHNldXJhdC5vYmplY3RAbWV0YS5kYXRhJG9yaWcuaWRlbnQgPT0gIkdNUG0iKSxdKQoJY291bnRzX2RmW2lkLCAiR01QbSJdID0gY2VsbF92YWx1ZQoKfQoKYGBgCgoKIyMjIEV2YWx1YXRlIGNsdXN0ZXIgc3RhYmlsaXR5CmBgYHtyIGZpZy5oZWlnaHQ9NX0KY2x1c3RyZWUoc2V1cmF0Lm9iamVjdCwgcHJlZml4ID0gIlJOQV9zbm5fcmVzLiIsIG5vZGVfY29sb3VyID0gInNjM19zdGFiaWxpdHkiKSArIAoJc2NhbGVfY29sb3JfY29udGludW91cyhsb3cgPSAncmVkMycsIGhpZ2ggPSAnd2hpdGUnKQpgYGAKCgoKYGBge3IgZmlnLmhlaWdodD01fQpjbHVzdHJlZShzZXVyYXQub2JqZWN0LCBwcmVmaXggPSAiUk5BX3Nubl9yZXMuIiwgZXhwcmVzID0gJ2RhdGEnLCBub2RlX2NvbG91ciA9ICJzYzNfc3RhYmlsaXR5IikgKyAKCXNjYWxlX2NvbG9yX2NvbnRpbnVvdXMobG93ID0gJ3JlZDMnLCBoaWdoID0gJ3doaXRlJykKYGBgCgoKYGBge3IgZmlnLmhlaWdodD01fQpjbHVzdHJlZShzZXVyYXQub2JqZWN0LCBwcmVmaXggPSAiUk5BX3Nubl9yZXMuIiwgZXhwcmVzID0gJ3NjYWxlLmRhdGEnLCBub2RlX2NvbG91ciA9ICJzYzNfc3RhYmlsaXR5IikgKyAKCXNjYWxlX2NvbG9yX2NvbnRpbnVvdXMobG93ID0gJ3JlZDMnLCBoaWdoID0gJ3doaXRlJykKYGBgCgoKCmBgYHtyIGZpZy5oZWlnaHQ9NX0KY2x1c3RyZWUoc2V1cmF0Lm9iamVjdCwgcHJlZml4ID0gIlJOQV9zbm5fcmVzLiIsIGV4cHJlcyA9ICdjb3VudHMnLCBub2RlX2NvbG91ciA9ICJzYzNfc3RhYmlsaXR5IikgKyAKCXNjYWxlX2NvbG9yX2NvbnRpbnVvdXMobG93ID0gJ3JlZDMnLCBoaWdoID0gJ3doaXRlJykKYGBgCgoKCgoKCgoKCgoKCgoKIyBER0UKSSB0aGluayBjbHVzdGVycyBmcm9tIDkwJSB2YXJpYW5jZSBhdCAwLjUgYW5kIDEuMCByZXNvbHV0aW9uIGFyZSBtb3N0IHN0YWJsZS4gV2UnbGwgZG8gc29tZSBzdGF0aXN0aWNzIGFuZCBER0Ugb24gdGhhdC4gV2lsbCBhbHNvIG5lZWQgdG8gZ28gYmFjayBhbmQgcGxheSB3aXRoIFNDVHJhbnNmb3JtLCBzaW5jZSB0aGVzZSBhcmUgbXVsdGlwbGUgY2VsbCB0eXBlcyBmcm9tIG11bHRpcGxlIGxhbmVzLgoKYGBge3J9CnNldXJhdC5vYmplCmBgYAoKCgoKIyBOb3RlcyBvbiBjbHVzdGVyIHN0YWJpbGl0eQpDbHVzdGVyIHN0YWJpbGl0eSBjb3VsZCBiZSBpbmZsdWVuY2VkIGJ5OgoqIGNlbGxzIGluIGVhY2ggcG9wdWxhdGlvbiAoY2VsbHJhbmdlciB2NiBpbmNsdWRlcyBtb3JlIGNlbGxzIHRoYW4gY2VsbHJhbmdlciB2MSwgZXNwZWNpYWxseSBpbiBNRVApCiogZGltZW5zaW9uYWxpdHkgaXMgaW5jb3JyZWN0CiogU2NhbGVEYXRhIGRpZG50IGFjY291bnQgZm9yIHJlZ3Jlc3Npb24gZmFjdG9ycyAoZS5nLiwgIm5Db3VudHNfUk5BIiBvciAibkZlYXR1cmVzX1JOQSIpCiogRGlkIG5vdCBjb25zaWRlciBjZWxsIGN5Y2xlCiogSW5jb3JyZWN0IG5vcm1hbGl6YXRpb24vc2NhbGluZyBtZXRob2QKKiBDbHVzdGVyaW5nIGlzIHRvbyBzdHJpY3Qgb3Igbm90IHN0cmljdCBlbm91Z2gKKiBuZWlnaGJvcmhvb2QgYW5hbHlzaXMgdXNlZCB3cm9uZyBwYXJhbWV0ZXJzCiogU2hvdWxkIGluY2x1ZGUgbWl0b0MgZmlsdGVyICh0aGVyZSdzIGEgY2h1bmsgb2YgTUVQIHcvIG1pdG9DIEAgfjQwJSkKKiBTQ1RyYW5zZm9ybSBhY2NvdW50cyBiZXR0ZXIgZm9yIHNvdXJjZXMgb2YgdmFyaWFiaWxpdHkKCmBgYHtyfQojIE51bWJlciBvZiBmaWx0ZXJlZCBjZWxscyBsZWZ0IGluIGVhY2ggcG9wCnNhcHBseShjKCJMU0ttMiIsICJDTVBtMiIsICJNRVBtIiwgIkdNUG0iKSwgZnVuY3Rpb24oeCkgKGMobnJvdyhzZXVyYXQub2JqZWN0QG1ldGEuZGF0YVtzZXVyYXQub2JqZWN0QG1ldGEuZGF0YSRvcmlnLmlkZW50ID09IHgsXSkpKSkKYGBgCgpgYGB7cn0KZm9yICh4IGluIGMoIkxTS20yIiwgIkNNUG0yIiwgIk1FUG0iLCAiR01QbSIpKXsKCWggPSBoaXN0KHNldXJhdC5vYmplY3RAbWV0YS5kYXRhW3NldXJhdC5vYmplY3RAbWV0YS5kYXRhJG9yaWcuaWRlbnQgPT0geCwgJ3BlcmNlbnQubXQnXSwgYnJlYWtzID0gMzAsIHBsb3QgPSBGQUxTRSkKCWgkZGVuc2l0eSA9IGgkY291bnRzL3N1bShoJGNvdW50cykqMTAwCglwbG90KGgsZnJlcT1GQUxTRSwgbWFpbiA9ICBwYXN0ZSh4LCAicGVyY2VudCBtaXRvQyIpLCB4bGFiID0gInBlcmNlbnQgbWl0b0MiLCB5bGFiID0gIkZyZXF1ZW5jeSIpCn0KYGBgCgpMb29rcyBsaWtlIE1FUG0gaXMgdGhlIG9ubHkgc2FtcGxlIHdpdGggdGhhdCBodWdlIE1pdG9DICUgbHVtcCBAIDQwJS4gV2hhdCBkbyB0aGVzZSBjZWxscyBsb29rIGxpa2UsIG90aGVyd2lzZT8KCmBgYHtyIGZpZy53aWR0aD01fQpWbG5QbG90KHN1YnNldChzZXVyYXQub2JqZWN0LCBzdWJzZXQgPSBvcmlnLmlkZW50ID09ICJNRVBtIiksIAoJCQkJZmVhdHVyZXMgPSBjKCJuRmVhdHVyZV9STkEiLCAibkNvdW50X1JOQSIsICJwZXJjZW50Lm10IiksIG5jb2wgPSAxLCBwdC5zaXplID0gMCwgZmlsbC5ieSA9ICdpZGVudCcsIGZsaXAgPSBUUlVFKQpgYGAK